Creating Musical Expression using Kinect

نویسندگان

  • Min-Joon Yoo
  • Jin-Wook Beak
  • In-Kwon Lee
چکیده

Recently, Microsoft introduced a game interface called Kinect for the Xbox 360 video game platform. This interface enables users to control and interact with the game console without the need to touch a controller. It largely increases the users’ degree of freedom to express their emotion. In this paper, we first describe the system we developed to use this interface for sound generation and controlling musical expression. The skeleton data are extracted from users’ motions and the data are translated to pre-defined MIDI data. We then use the MIDI data to control several applications. To allow the translation between the data, we implemented a simple Kinect-to-MIDI data convertor, which is introduced in this paper. We describe two applications to make music with Kinect: we first generate sound with Max/MSP, and then control the adlib with our own adlib generating system by the body movements of the users.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Motion and Synchronization Analysis of Musical Ensembles with the Kinect

Music ensembles have to synchronize their performances with highest precision in order to achieve the desired musical results. For that purpose the musicians do not only rely on their auditory perception but also perceive and interpret the movements and gestures of their ensemble colleges. In this paper we present a method for motion analysis of musical ensembles based on head tracking with a K...

متن کامل

Gekipe, a gesture-based interface for audiovisual performance

We present here GeKiPe, a gestural interface for musical expression, combining images and sounds, generated and controlled in real time by a performer. GeKiPe is developed as part of a creation project, exploring the control of virtual instruments through the analysis of gestures specific to instrumentalists, and to percussionists in particular. GeKiPe was used for the creation of a collaborati...

متن کامل

The Third Room: A 3D Virtual Music Framework

This paper describes a new paradigm for music creation using 3D audio and visual techniques. It describes the Third Room, which uses a Kinect to place users in a virtual environment to interact with new instruments for musical expression. Users can also interact with smart objects, including the Ember (modified mbira digital interface) and the Fluid (a wireless six degrees of freedom and touch ...

متن کامل

Interactive Music: Human Motion Initiated Music Generation Using Skeletal Tracking By Kinect

This work experiments with human motion initiated music generation. Here we present a stand-alone system to tag human motions readily into musical notes. We do this by first discovering the human skeleton using depth images acquired by infrared range sensors and then exploiting the resultant skeletal tracking. This realtime skeletal tracking is done using the videogame console Microsoft KinectT...

متن کامل

Orchestra: Wireless Sensor System for Augmented Performances & Fusion with Kinect

We pushed the development of numediart MARG (Magnetic, Angular Rate and Gravity) sensors, started within the FireTraSe project, one step further, from a prototype towards a more productoriented design. Our new master sensor nodes come with embedded WiFi transmitters and Lithium Polymer Battery charger. The attitude of each MARG sensor can be computed, providing the orientation of each performer...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2011